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TIME-STAGED  LINEAR  PROGRAMS 


Assuming  no  redundant  equations,  a  basic  solution  to  the  primal 


system  must  have  m^  +  A^  m^  basic  variables  among  the  components  of 
in  order  to  satisfy  the  constraints  of  the  first  period.  For 

subsequent  periods  we  have  m^  +  A^  basic  variables  where  A^  >  0 
measures  the  excess  over  the  number  of  equations  and  A^  <  0  the  deficit . 
If  A^  =  0  for  all  periods,  the  basis  is  called  square  or  balanced- 
block  diagonal,  [1],  [2]. 


Structure  of  the  Basis 


Assumes  that  the  system  has  no  redundant  equations. 


Properties 

m2  —  ®  *  0  A^  m2 

m^  2.  A^  "b  ^2  —  ®  *  — ®2  _£_  A2  2.  ®2 

m.  >  A,  +  A.  +  A„  >  0  t  -m.  <  A.  <  m. 

4— 1  2  3—  3—3—4 

m,  >  A,  +  A„  +  A„  +  A,  )  0  ,  -m.  <  A,  <  mc 

5— 1  2  3  4  —  4—4—5 

0  =  A,  +  A„  +  A.  +  A,  +  Ae  «  0  ,  -mc  <  A_  <  0 
1  2  3  4  5  5—5  — 

Given  a  discrete  time  structure  derived  from  a  continuous 
time  problem;  suppose  that  an  activity  initiated  at  time  t  =  t^  is 
likely  to  persist  to  some  time  t  ■  t2  when  it  is  replaced  by  some 
other  activity  that  again  persists  for  some  time  etc.,  —  then  "for 
almost  all"  periods  A^  **  0. 

Proof :  We  assume  between  time  points  t^,  t2  that  there  are  exactly 
m  +  A  activities  that  operate  at  a  positive  level  where  m  is  the 
number  of  relations  that  must  hold  at  each  point  t  in  time 
t^  c2*  Assume  a  fine  time  division  for  the  discrete  time  approxi¬ 

mation  to  the  continuous  time  and  that  these  same  activities  operate 
at  positive  levels  between  t^  and  t2>  Assume  that  the  number  of  these 
basic  activities  in  each  period  remains  invariant: 
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T 


m  +  A  ,  ^  1  i.  c2 

The  discrete  time  indices  corresponding  to  t^  and  t2  will  be 
denoted  by  and  k^. 

By  the  properties  just  discussed,  we  have  at  t^  and  t2 


m 


2  0 


whence 


m  2  l 


Ai  + 


>  0 


k.+l 


m  >  m 


kl 


>  l 


ki+1 


Ai^ 


m  2  (k2  “  2  -ra  * 


where 


k 


2 


is  the  number  of  discrete  time  points  between  t^  <  t  <  tj  and  A, 
the  excess  or  deficit  in  the  number  of  activities  over  m,  is  a  fixed 
integer  independent  of  the  number  of  subdivisions.  It  is  clear  that 
as  the  number  of  subdivisions  ■>  +  “,  that  the  inequalities  cannot  hold 
unless  A  =  0.  The  proof  is  the  same  as  that  given  in  [1]. 
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If  the  basis  B  had  square  non-singular  diagonal  blocks,  it 
would  be  easy  to  solve  BX  ■  b  or  irB  ■  y.  The  effort  would  be 
proportionate  to  T.  In  general  when  the  activities  have  the  persistence 
quality,  most  diagonal  blocks  can  he  expected  to  be  m  x  m  but  not  neces¬ 
sarily  non-singular. 

How  to  Square  a  Basis 


Max  Linearly (MLI) 
Independent 


□ 

□  □ 

□  e 


ML  I 


ML  I 

01 


ML  I 


Theorem:  The  blocks  of  Independent  rows  for  each  time  period  are 
square. 

Proof:  The  number  of  columns  associated  with  each  set  of  linearly 
independent  rows  is  greater  or  equal  to  the  number  of  rows  implying 
that  the  total  number  of  columns  _>  the  total  number  of  linearly 
independent  rows.  However,  these  totals  are  equal  implying  equality 
for  each  set. 

Other  Nice  Properties 

If  the  largest  independent  number  of  rows  used  to  do  the  elimina¬ 


tions  are  selected  from  the  diagonal  blocks  (to  the  maximum  extent 
possible) ,  then  advantage  can  be  taken  of  any  repetition  of  blocks 
along  the  diagonal. 


I 


!Max  linearly  independent  rows 
should  be  chosen  from  diagonal 
blocks  first  (if  possible). 


move 

up 


H//////71  L.I. 


For  a  more  detailed  discussion  of  the  material  discussed  so  far  see 
R.  Fourer  [  3  ] . 

FINDING  A  FEASIBLE  SOLUTION  TO  A  STAIRCASE  PROBLEM 
Myopic  Approach 

The  approach  is  similar  to  that  used  in  many  econometric  models 
and  found  in  practice  in  industry. 

Start  with  any  guess  about  future  prices.  Say 


o 


IT 


2 


-  0, 


0 


Solve  1st  period  problem  with  cost  row  c^  adjusted  for  future  prices. 


Ad j .  Cost:  d^  =  c^  +  tt° 


yields  \ 


Unless  not  feasible,  in  which  case  the  full  system  is  not  feasible  and 


we  stop. 


Solve  2nd  period  problem  with  cost  row  c 2  adjusted  for  future  prices. 


Ad j .  Cost:  ^2  =  C2  +  ^3  B2 
2nd  Period  Starting  Inventory:  a2  =  +  B1  ^1 


^2  ^2  * 

x2  >  0 

MIN(d2  X2) 

(  =  X° 

l2  X2 


unless  not  feasible. 


For  k  =  (2,  T) ,  solve  kth  period  problem: 


Adi.  Cost:  d.  =  c,  +  ir,  B  ,  k  <  T;  d  =  c 
J  k  k  k+1  k  T  T 


Inventory:  afc  =  bk  + 


\  =  \  \  » 

\  >  o 

M!N(dk  X^ 

yields  \  =  \ 


unless  k-th  problem  is  not  feasible. 


♦jw*  - 


Comment 


1.  If  the  original  problem  represents  a  real  world  problem,  and  the 
set  of  activities  is  sufficiently  rich,  then  there  will  always 
be  a  feasible  solution  no  matter  what  starting  inventory  vector 
a^,  at  the  start  of  period  k,  is  inherited  from  the  past. 

2.  It  is  anticipated  for  most  practical  models  that  the  myopic 
approach  will  seldom  run  into  an  infeasibility.  In  other  words 
finding  a  starting  feasible  solution 


will  be  a  relatively  cheap  process. 

3.  If 


\  V 


>  0 


is  infeasible  then  instead  of 


X, ,  a  vector 
k 


a.  will  be 
k 


produced  such  that  A^2.0>  ^  Indeed  unless  there 

exists  an  a^  such  that  o°  >  0  the  full  system  is  infeasible. 


Therefore  we  seek  an 


V] 


such  that 


°k  ak  “  ak(bk  +  Bk-1  \-l}  ° 


This  relation,  called  a  CUT,  is  added  to  the  (k-l)st  period  problem. 
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CUT: 


(0k°  Vi>Vi  2  -(\bk) 


Either  a  new  solution  X,  ,  =  X,  ,  is  produced  and  we  can 

k-1  k-1 

proceed  forward  again  or  the  k  -  1st  period  problem  has  been  rendered 

infeasible  by  the  cut  causing,  in  turn,  a  cut  for  period  k  -  2  etc. 

If  the  k-1  period  problem  is  feasible  with  the  cut,  it  may  lead  to 
a  feasible  solution  to  the  k-period  problem,  or  if  the  k-period  problem 
remains  infeasible,  cause  still  another  cut  for  the  k-1  period  to 
be  generated: 

CUT: 


Cuts  when  added  will  initially  be  tight  but  subsequently  might 
go  slack.  When  this  happens  it  is  recommended  they  be  dropped.  If 
cuts  back-up  all  the  way  to  the  first  period  and  the  first  period  is 
rendered  infeasible,  it  implies  that  the  primal  is  infeasible.  If  so, 
the  algorithm  is  terminated . 
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Feasible  Basis 


CUTS 


As  noted,  there  are  likely  to  be  only  a  few  such  feasibility  cuts,  however. 

Getting  a  Feasible  Dual  Solution 

Given  a  primal  feasible  solution 

i*  X-j  "  XT  > 

find  a  dual  feasible  solution  by  an  analogous  myopic  algorithm: 

T-th  Period  Problem 
Set  aT  ■  bT  +  Bt-1  X°_1.  Solve 

o 

yields  ttt  -  it 


This  problem  has  feasible  solutions  by  hypothesis. 


aT  ^T  XT  ’ 

3^  >  0 

MIN(ct  X^ 

Xl* 


X2  =  X2  ’ 


Vl  "  *T- 
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r 


If  it  has  an  infinite  minimum,  then  terminate  with  class  of  feasible 
solutions  such  that  MIN  -*■-<».  If  finite  minimum  let  ttt  =  n°  be 
optimal . 


k-th  Period  Problem 
Set  ak  =  bk  +  Bk-1  i{_1  , 


dk  =  Ck  +  \+l  ®k 


Solve 


\  =  \  xk  » 

Xk  >  ° 

M!N(dk  3^) 

yields  irk  =  it 


or  if  MIN  -*  -<*>,  a  homogeneous  solution 

Yk  “  Yk  ^  ° 

such  that 

Ak  Yk  "  0 

and 

dkYk<0  ' 

In  practice  we  would  expect  the  case  of  MIN  -*■“«>  rarely 
if  ever  to  occur.  We  will  discuss  below  what  to  do  if  it  does  occur. 
We  would  expect  the  above  algorithm  to  quickly  solve  to  give  a  good 
estimate  of  (tt°,  ...,  it  °) .  The  new  estimate  of  ir°  could  then  be 
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used  to  initiate  another  estimate  of  X.  Since  exactly  m^  basic  X 
for  each  period  1  are  obtained  we  know  that  this  process  can  never 
converge  to  a  case  for  which  t  0.  Hence,  repeated  recycling  of  the 
algorithm  will  not,  in  general,  converge  to  an  optimal  solution.  Before 
discussing  a  procedure  that  will,  we  will  dispose  of  the  case 
MlN(dk  X,)-*-  -  <». 

To  illustrate,  consider  k  *  T  -  1.  We  are  interested  in  know¬ 
ing  whether  or  not  the  finding  of  a  class  of  feasible  solutions  to  the 
T-lst  problem  such  that  MIN(dT_^  X^  implies  that  1^-°°  ^or 

the  two-stage  problem  below  consisting  of  the  last  two  periods: 


aT-l  ~  ^T-l  ^T-l  » 


(XT-1’  V  -  0 


T-l  T-l 


+  A„ 


XT 


MIN  Z 


T-l 


c  ,  X  ,  +  c_  X 
T-l  T-l  T  T 


If  Z^,  -»■  -  <*>,  it  implies  that  Z-*  - 00  for  the  full  system.  The 

iterative  loop  about  to  be  described,  could  generate  several  additional 
homogeneous  solutions  Y°_^,  Y^_^,  ..»,  Y,p_^  to  the  T-l  period 
problem  where  r  is  finite.  To  see  this  note  that 


*1-1 


T-l 


r 

l 

i-0 


T-l  i 
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X1  >  0 


for  any  particular  choice  of  is  a  feasible  solution  to  the  T-lst 

period  problem.  Therefore  we  can  set 


P 


i 


T-l 


i 


Y 


'T-l 


1 


and  associate  with  such  a  solution  a  redefined  T-th  period  problem 


r+1 
"T  : 


L  . 

-I  P1  Ai  +  ^  XT  ,  Ai  >  0  ,  5^  >  0 


r  , 

MIN([  Y  +  cT  XT) 


TT„,  = 

r+1 

7T 

T 

T 

r+1 

pr+l 

T-l’ 

r+l 

generate  a  d^  ^  =  d^_^  and  possibly  generate  Y, 

Only  a  finite  number  of  Y^_^  can  be  so  generated  because  each 
corresponds  to  an  extreme  ray  of  the  T-lst  period  problem.  Therefore 
for  a  sufficiently  large  r,  nT  prices  out  non-negative  for  every 
possible  (y^>  Pi)  column  that  can  be  generated  by  extreme  homogeneous 
solutions  Y*  ^  0.  Therefore 


4  r  1  r  i  r  i 

o  <  VA  +  /  P1  »  (c  ,  +  t ri  Bm  JYZ  -  =  d_  .  Y_  . 
—  1  T  x  T-l  T  T— 1  T-l  T— 1  T-l 


r  i  i 

i.e.,  YT_^  2.  0  for  all  possible  homogeneous  solutions  Y,j,_^. 
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Thus,  the  case  MIN(dT_1  does  not  occur  for  it*  for 

some  finite  r  sufficiently  large. 

On  the  other  hand  if  a  redefined  T-th  period  problem  has  a 
MIN-*--®,  we  terminate  with  a  class  of  feasible  solutions  to  the 
original  primal  -*•-».  This  class  can  be  written  in  the  form 

X  -  (X°,  ....  X^_1  +  0  l  Y^_1  A°,  X°  +  6  Y°)  >  0  as  0  - 

where  (A°,  . ..,  A°,  Y°)  ^  0  is  a  homogeneous  solution  to  the  redefined 
T-th  period  problem  with  the  property  that  YX°  +  c^,  Y°  <  0. 

Assuming  we  have  found  a  feasible  primal  and  dual  solution, 
we  now  turn  to  finding  an  optimal  solution. 
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FINDING  AN  OPTIMAL  FEASIBLE  SOLUTION 


The  Imbedded  Decomposition  Approach  of  Manne  and  Ho  [ 4  )  and 
of  Glassey  [  5  ],  will  be  applied  to  the  dual  rather  than, as  they 
did, to  the  primal.  The  principal  advantages  are, or  are  believed  to 
be:  (1)  The  primal  solution  is  obtained  without  any  need  to  reconsti¬ 

tute  the  underlying  solution  from  various  weighted  combinations  of 
variables  generated  by  the  process;  (2)  The  solution  should  be  more 
stable  because  starting  off  with  a  small  error  in  X  would  only 
make  the  second  period  starting  inventory  vector  slightly  wrong.  For 
practical  dynamic  planning  problems  the  slightly  wrong  second  period 
starting  inventory  vector  is  just  as  acceptable  as  the  correct  one. 

(3)  The  myopic  type  steps  described  earlier,  will  be  all  that  is 
required  (with  some  occasional  back-tracking)  to  solve  the  system. 
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MASTER(l)  produces  ■  X*  and  SUB(l)  (which  returns  ■  ir*) . 
SUB(l)  is  a  problem  of  the  same  form  except  starting  at  t  ■  2  with 
b2  replaced  by  a2  “  ^2  +  B1  X*'  Hence  can  be  partitioned  in 

the  same  way  into  a  MASTER(2)  and  a  SUB(2),  etc. 

We  will,  however,  use  an  inductive  approach  solving  the  above 
problem  assuming  ir  ■  •••»  ^  *  ^T'  T**is  can  solved  as  a 

t-period  problem  with  irt  At  -  it  ^  Bt  cfc  replaced  by 


\  At  i  ct  +  fft+l  Bt 
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I 


The  MASTER(£)  Problem  has  the  form:  For  1  ■  (1,  t) 


\ai  +  plfl  +  a  lhm***L  ^C6S 


(Pj, »  Oj)  J>  0  ,  ir^  F^  -  al 


:Xt 


P£  6 


1  :e* 


where  e  »  (1,  1,  1)'. 


MASTER(H)  is  related  to  that  of  l  -  1  by 


(1) 


ai‘  hl+  Bi-1  X*-l  * 


a  =  (2,  ....  t) 


a 


1 


b 


1 


and  related  to  that  of  £  +  1  as  follows:  Let  f^,  F*  denote  the 
i-th  component  of  f  and  column  of  F^,  then  for  £  -  (1,  t- 


f£  =  71  £+1  b£+l  +  P£+l  f£+l  +  °£+l  g£+l 


(2) 


Vi  B* 
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for  some  extreme  solution  (*£+]_»  p^+i*  °i+l^  MASTER (£  +  1).  In 

an  analogous  way,  let  g*,  G*  denote  the  i-th  component  of  g^  and 

column  of  G„.  Then 
£ 


ni+ 1  b£+l  +  °£+l  8£+l 


(2.1) 


\+l  B£ 


for  some  homogeneous  solution  0 

\+l  A  "  °M  G£+l  1  °*  and  \+l  a£+l 
For  the  case  £  *■  t,  we  define, 


+  o 


£+1 


such  that 
8£+l  >  °*‘ 


ft  "  l  \  bi 

t+1 


(3) 


71 1+1  Vi 


r  i 

Note  in  (2.1)  terms  involving  have  been  omitted  because 

epj+^  "  1  means  that  2.  0  cannot  enter  as  part  of  a  homogeneous 

solution 
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Iterative  algorithm  is  initiated  by  setting  t  -  1,  l  »  1, 
applying  formula  (3),  and  then  going  to  CYCLE. 

CYCLE: 


I.  Optimize  MASTER (£); 

r  r  r 

Determine  the  optimal  solution:  MAX^,  * j,»  0^>  where  r  - 

is  the  number  of  columns  in  F^_^  or  if 
homogeneous  solution  per  (2.1). 

II.  If  l  >  1  and  MAX£  >  6^  1  go  BACKWARD  to  MASTER (£  -  1) 
as  follows: 


MAX|  +  determine 


Augment  MASTER(£,  -  1)  by  tacking  on  an  r-th  component  to  p 
by  using  (tt^,  Pjl,  at)  =  p£,  to  determine  f^, 

F*  ^  by  (2)  or  if  MAX^-  +  ®,  determine  g*,  G*,  by  (2.1).  Set 

l  -  l  -  1; 

GO  TO  CYCLE; 

III.  If  l  =  1  or  if  i  >  1  and  MAX^  <  6^,  then 


If  1  =  1,  TERMINATE  X  =  X*  is  optimal; 

If  l  <  T,  go  FORWARD  to  MASTERU  +  1)  as  follows: 

If  t,  «  t,  set  t  -  t  +  1  and  determine  ft>  F  by  (3); 

Set  1*1+1;  use  X*  to  determine  a£  by  (1); 

GO  TO  CYCLE. 
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Comments 


In  practice  it  is  more  convenient  to  work  with  the  dual  of 
MASTER(i).  The  inequalities  corresponding  to  the  components  of 
are  cuts  representing  surrogate  constraints  for  future  prices.  There 
may  be  feasibility  cuts  as  well.  We  therefore  highlight  the  iterative 
algorithm  described  above  in  its  primal  setting: 


8-th  PERIOD  PROBLEM 


Surrogate  Cuts  for 
future  prices  and  needs 

Feasibility  Cuts 


If  8.-th  period  problem  is  infeasible,  it  will  give  rise  at  end 
*  \ k 

of  Phase  I  to  II^,  and  a  relation  which  the  current  value  of  a^ 
does  not  satisfy.  For  feasibility,  the  current  a^  should  satisfy 
(but  does  not) 


**  a*  +  at  H  <  0 
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where 


0*  ^  0  ’  n*  A*  “  °*  G£  1  0 


We  therefore  seek  an  whose  does.  Substituting 


b£  +  Vl  Vl 


we  generate  a  cut  for  dual  of  MASTER(£  -  1),  see  (2.1),  namely 


-<*{  >-MSbt  +  0*t6, 


Feasibility  Cut 


and  return  to  MASTER(£  -  1). 

If  £-th  period  problem  is  feasible,  let  the  optimal  solution 
be  (X*,  0*;  tt^,  p*,  a^) .  If  any  of  the  CUTS  for  this  solution  are 
slack  it  is  recommended  that  they  be  dropped . 

The  test  for  moving  forward  to  l  +  1  is  feasibility  and 


MIKt<  8*^ 


If  feasible  and  test  is  yes,  one  moves  forward  to  £  +  1  by  setting 


Vi  ‘  bm  +  \  XS 


Adj  .  RHS  f  or  <1+1 


23 


If  feasible  and  test  is  no,  one  returns  to  £  —  1  with  a  new  cut,  see 
(2),  namely 


®2-l  ”  (1TJ l  B£-l) X£-l  -  "SL 


v  r  ,  .  r  ,  .  r 
>  b„  +  p£  f£  +  a£ 


Look-ahead  Cut 


which  is  a  surrogate  cut  reflecting  future  prices  and  requirements.  If 
infeasible  then  one  returns  to  (2-1)  with  a  feasibility  cut  described 
earlier. 

Note  that  once  a  cut  is  imposed  we  are  recommending  it  be  successively 
tested  and  "passed  back"  to  period  2-2,  2-3,  ...  until  the  test 
says  to  move  forward  again  and  then  to  move  forward  removing  any 

cuts  that  are  made  slack  by  the  current  primal  solution  X*,  X* . 

It  may  be  better  tactics,  however,  after  reoptimizing  2-1  to 
return  to  2  seeking  more  cuts  until  no  more  are  passed  back  to 
2-1.  At  this  point  check  MIN£ -  0*_2  >  0.  If  yes,  return  to 
2-2  with  cuts  else  move  forward  to  2. 

This  paper  is  based  on  a  draft  prepared  around  1977  describing  the 
imbedded  dual  decomposition  approach  for  solving  staircase  systems. 

Philip  Abrahamson  [6]  and  Robert  Wittrock  in  their  research,  have 
experimented  with  a  variety  of  factors,  variants  and  hybrids  with 
other  approaches.  Their  results  are  expected  to  be  published  soon. 
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